Adaptive Scheduling Strategy for Heterogeneous Spark Cluster
نویسندگان
چکیده
منابع مشابه
An Adaptive Job Allocation Strategy for Heterogeneous Multi-cluster Systems
In this paper, we propose a new job allocation system for multiclusters environments, named the Adaptive Job Allocation Strategy (AJAS), in which a scheduler uses a self-scheduling scheme to dispatch jobs to appropriate distributed resources. Our strategy focuses on increasing resource utility by dispatching jobs to computing nodes with similar performance capacities to equalize job execution t...
متن کاملAn Improved Adaptive Space-Sharing Scheduling Policy for Non-dedicated Heterogeneous Cluster Systems
Adaptive space-sharing scheduling algorithms tend to improve the performance of clusters by allocating processors to jobs based on the current system load. The focus of existing adaptive algorithms is on dedicated homogeneous and heterogeneous clusters. However commodity clusters are naturally non-dedicated and tend to be heterogeneous over the time as cluster hardware is usually upgraded and n...
متن کاملPerformance Evaluation of Adaptive Scheduling Algorithm for Shared Heterogeneous Cluster Systems
Cluster computing systems have recently generated enormous interest for providing easily scalable and cost-effective parallel computing solution for processing large-scale applications. Various adaptive space-sharing scheduling algorithms have been proposed to improve the performance of dedicated and homogeneous clusters. But commodity clusters are naturally nondedicated and tend to be heteroge...
متن کاملEfficient scheduling strategy for task graphs in heterogeneous computing environment
Today’s multi-computer systems are heterogeneous in nature, i.e., the machines they are composed of, have varying processing capabilities and are interconnected through high speed networks, thus, making them suitable for performing diverse set of computing-intensive applications. In order to exploit the high performance of such a distributed system, efficient mapping of the tasks on available m...
متن کاملA Decentralized Strategy for Genetic Scheduling in Heterogeneous Environments
The paper describes a solution to the key problem of ensuring high performance behavior of the Grid, namely the scheduling of activities. It presents a distributed, fault-tolerant, scalable and efficient solution for optimizing task assignment. The scheduler uses a combination of genetic algorithms and lookup services for obtaining a scalable and highly reliable optimization tool. The experimen...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computer Science and Application
سال: 2016
ISSN: 2161-8801,2161-881X
DOI: 10.12677/csa.2016.611084